METHODS AND SYSTEMS FOR TRANSMITTING DELAYED ACCESS 
CLIENT GENERIC DATA-ON DEMAND SERVICES 



RELATED APPLICATIONS 

This application is a continuation-in-part claiming priority to Khoi Hoang's patent 
applications entitled A Method And Apparatus For Transmitting Non-Vod 
Services, filed on October 25, 2001, bearing Attorney Docket Number 60595-301801; 
Selective Inactivation And Copy-Protection, filed on August 20, 2001, bearing 
application number 09/933,696, Controlling Data-On-Demand Client Access, filed 
on July 9, 2001, bearing application number 09/902,503, DECREASED IDLE TIME And 
Constant Bandwidth Data-On-Demand Broadcast Delivery Matrices, filed on 
June 25, 2001, bearing application number 09/892,017, Counterfeit STB Prevention 
Through Protocol Switching, filed on June 25, 2001, bearing application number 
09/892,015, Universal STB Architectures And Control Methods filed on May 30, 
2001, bearing application number 09/870,879, Non Client Specific On-Demand Data 
Broadcast (Amended) filed on May 31, 2000, bearing application number 09/584,832, 
Methods For Providing Video-On-Demand Services For Broadcasting Systems 
filed November 10, 2000, bearing application number 09/709,948 and Universal 
Digital Broadcast System And Methods filed on April 24, 2001, bearing application 
number 09/841,792, all nine being incorporated herein by reference. 

FIELD OF THE INVENTION 

This invention relates generally to data-on-demand systems. In particular, this 
invention relates to data transmission scheduling. 

BACKGROUND OF THE INVENTION 

Video-on-demand (VOD) systems are one type of data-on-demand (DOD) 
system. In VOD systems, video data files are provided by a server or a network of 
servers to one or more clients on a demand basis. 

In a conventional VOD architecture, a server or a network of servers 
communicates with clients in a standard hierarchical client-server model. For example, a 
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client sends a request to a server for a data file (e.g., a video data file). In response to the 
client request, the server sends the requested file to the client. In the standard client- 
server model, a client's request for a data file can be fulfilled by one or more servers. 
The client may have the capability to store any received data file locally in non- volatile 
memory for later use. The standard client-server model requires a two-way 
communications infrastructure. Currently, two-way communications requires building 
new infrastructure because existing cables can only provide one-way communications. 
Examples of two-way communications infrastructure are hybrid fiber optics coaxial 
cables (HFC) or all fiber infrastructure. Replacing existing cables is very costly and the 
resulting services may not be affordable to most users. 

In addition, the standard client-server model has many limitations when a service 
provider (e.g., a cable company) attempts to provide VOD services to a large number of 
clients. One limitation of the standard client-server model is that the service provider has 
to implement a mechanism to continuously listen and fulfill every request from each 
client within the network; thus, the number of clients who can receive service is 
dependent on the capacity of such a mechanism. One mechanism uses massively-parallel 
computers having large and fast disk arrays as local servers. However, even the fastest 
existing local server can only deliver video data streams to about 1000 to 2000 clients at 
one time. Thus, in order to service more clients, the number of local servers must 
increase. Increasing local servers requires more upper level servers to maintain control of 
the local servers. 

Another limitation of the standard client-server model is that each client requires 
its own bandwidth. Thus, the total required bandwidth is directly proportional to the 
number of subscribing clients. Cache memory within local servers has been used to 
improve bandwidth limitations but using cache memory does not solve the problem 
because cache memory is also limited. 

Presently, in order to make video-on-demand services more affordable for clients, 
existing service providers are increasing the ratio of clients per local server above the 
local server's capabilities. Typically, a local server, which is capable of providing 
service to 1000 clients, is actually committed to service 10,000 clients. This technique 
may work if most of the subscribing clients do not order videos at the same time. 
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However, this technique is a set up for failure because most clients are likely to want to 
view videos at the same time (e.g., evenings and weekends), causing the local server to 
become overloaded during such peak hours. 

Thus, it is desirable to provide a system that is capable of providing on-demand 
services to a large number of clients over virtually any transmission medium without 
replacing existing infrastructure. Furthermore, it is desirable to provide a client generic 
broadcast system having a transmission bandwidth that is unrelated to the number of 
subscribing customers. It is also desirable to provide a system that is capable of 
providing client generic sub-optimal data-on-demand services requiring reduced 
transmission bandwidth. 

SUMMARY OF THE INVENTION 

The present invention provides a DOD broadcast system capable of transmitting 
one or more data files as a reduced bandwidth client generic sequence of data blocks to a 
large number of clients simultaneously over a narrow bandwidth, without the need for bi- 
directional communication. The present invention further provides an STB capable of 
beginning to play a data file broadcast via a client generic format within a short time of 
the data file being ordered by a client. Further provided is a more bandwidth efficient 
method of downloading data files by delaying client access time to allow intelligent STBs 
to load portions of the data files before beginning to play the data files. 

Briefly, one aspect of the present invention is embodied in a data on 
demand (DOD) broadcast system for transmitting a plurality of data files, wherein each 
data file is transmitted as a reduced client generic sequence of data blocks, comprising: a 
DOD broadcast server for broadcasting a plurality of data files; a transmission medium 
communicatively coupled with the DOD broadcast server; a plurality of receivers 
communicatively coupled with the DOD broadcast server via the transmission medium; 
wherein the DOD broadcast server repeatedly transmits a plurality of data files in a 
reduced client generic format to the plurality of receivers via the transmission medium; 
wherein the receivers are operative to request authorization information corresponding to 
a selected data file; wherein the receivers are further operative to receive the 
authorization information; and wherein the receivers are further operative to display a 
portion of the selected data file to a user after a predetermined time period, wherein the 
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predetermined time period enables the receivers to store a portion of the data file before 
beginning to display the data file. 

Another embodiment of the present invention teaches a data-on-demand (DOD) 

broadcast method for transmitting a sub-optimal sequence of data blocks comprising the 

acts of: preparing a sub-optimal data transmission sequence of data blocks, wherein no 

two adjacent data blocks in the sequence are identical; transmitting a data file consisting 

of the sequence of data blocks in accordance with the sub-optimal transmission sequence 

to a plurality of clients in a non client specific manner such that a receiving client may 

begin to access the data file within a predetermined time period. Furthermore, the 

predetermined time period has a duration, and wherein the duration is responsive to 

information included in at least one of the sequence of data blocks. The act of preparing 

the sub-optimal data transmission sequence includes the acts of: receiving a data file; 

specifying a time interval; parsing the data file into a plurality of data blocks based on the 

time interval such that each data block is displayable during the time interval; 

determining a required number of time slots to send the data file, wherein each of the 

time slot has a duration substantially equal to the time interval; allocating to each time 

slot at least one of the plurality of data blocks. 

A data-on-demand system comprises a first set of channel servers, a central 

controlling server for controlling the first set of channel servers, a first set of up- 
converters coupled to the first set of channel servers, a combiner/amplifier coupled to the 
first set of up-converters, and a combiner/amplifier adapted to transmit data via a 
transmission medium. In an exemplary embodiment, the data-on-demand system further 
comprises a channel monitoring module for monitoring the system, a switch matrix, a 
second set of channel servers, and a second set of up-converters. The channel monitoring 
module is configured to report to the central controlling server when system failure 
occurs. The central controlling server, in response to report from the channel monitoring 
module, instructs the switch matrix to replace a defective channel server in the first set of 
channel servers with a channel server in the second set of channel servers and a defective 
up-converter in the first set of up-converters with an up-converter in the second set of 
up-converters. 

A method for receiving data files transmitted as a sub-optimal data block 
sequence, comprises the acts of: receiving a user input indicating at least one selected 
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data file; storing at least one of a plurality of data blocks of the sub-optimal data block 
sequence in a memory location during a predetermined time period; displaying at least a 
first portion of the data file to a user after the predetermined time period has elapsed; 
receiving at least one additional data block of the plurality of data blocks of the sub- 
optimal data block sequence; and displaying at least a second portion of the data file to 
the user by combining at least one of the stored data blocks with the at least one 
additional data block. 

The term set-top-box is not intended to be limited to devices which attach to a 
television, but may include any device which is capable of receiving broadcast 
transmissions in accordance with the methods of the present invention including 
advanced television systems and computers. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIGURE 1 A illustrates an exemplary DOD system in accordance with an 
embodiment of the invention; 

FIGURE IB illustrates an exemplary DOD system in accordance with 
another embodiment of the invention; 

FIGURE 2 illustrates an exemplary channel server in accordance with an 
embodiment of the invention; 

FIGURE 3 illustrates an exemplary set-top box in accordance with an 
embodiment of the invention; 

FIGURE 4 illustrates an exemplary process for generating a scheduling 
matrix in accordance with an embodiment of the invention; 

FIGURE 5 illustrates an exemplary process for generating a sub-optimal 
scheduling matrix in accordance with one embodiment of the present invention; 
and 

FIGURE 6 illustrates an exemplary STB process for displaying a data file 
transmitted using a sub-optimal scheduling matrix in accordance with one 
embodiment of the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

The present invention provides a DOD broadcast system capable of transmitting 
one or more data files as a sub-optimal sequence of data blocks to a large number of 
clients simultaneously over a narrow bandwidth, without the need for bi-directional 
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communication. The present invention further provides an STB capable of beginning to 
play a data file within a short time of the data file being ordered by a client. Further 
provided is a more bandwidth efficient method of downloading data files by delaying 
client access time to allow an intelligent STB to load portions of the data files before 

5 beginning to play the data files. 

Some potential methods of maximizing transmitted DOD data while minimizing 
transmission bandwidth include utilizing: constant bandwidth delivery matrices; and 
decreased idle time matrices. These and other methods are taught by Khoi Hoang's 
above referenced inventions. While these methods provide client generic DOD services 

10 in a time optimal manner, there are other possibilities for providing client generic DOD 
broadcast services that further reduce required transmission bandwidth in exchange for a 
delay in access time. 

Figure 1A illustrates an exemplary DOD system 100 in accordance with an 
embodiment of the invention. In this embodiment, the DOD system 100 provides data 

1 5 files, such as video files, on demand. However, the DOD system 100 is not limited to 
providing video files on demand but is also capable of providing other data files, for 
example, game files on demand. The DOD system 100 includes a central controlling 
server 102, a central storage 103, a plurality of channel servers 104a-104n, a plurality of 
up-converters 106a-106n, and a combiner/amplifier 108. The central controlling server 

20 102 controls the channel servers 104. The central storage 103 stores data files in digital 
format. In an exemplary embodiment, data files stored in the central storage 103 are 
accessible via a standard network interface (e.g., ethernet connection) by any authorized 
computer, such as the central controller server 102, connected to the network. Each 
channel server 104 is assigned to a channel and is coupled to an up-converter 106. The 

25 channel servers 104 provide data files that are retrieved from the central storage 103 in 
accordance with instructions from the central controlling server 102. The output of each 
channel server 104 is a quadrature amplitude modulation (QAM) modulated intermediate 
frequency (IF) signal having a suitable frequency for the corresponding up-converter 106. 
The QAM-modulated IF signals are dependent upon adopted standards. The current 

30 adopted standard in the United States is the data-over-cable-systems-interface- 
specification (DOCSIS) standard, which requires an approximately 43.75MHz IF 
frequency. The up-converters 106 convert IF signals received from the channel servers 
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104 to radio frequency signals (RF signals). The RF signals, which include frequency 
and bandwidth, are dependent on a desired channel and adopted standards. For example, 
under the current standard in the United States for a cable television channel 80, the RF 
signal has a frequency of approximately 559.25MHz and a bandwidth of approximately 
6MHz. The outputs of the up-converters 106 are applied to the combiner/amplifier 108. 
The combiner/amplifier 108 amplifies, conditions, and combines the received RF signals 
then outputs the signals out to a transmission medium 1 10. 

In an exemplary embodiment, the central controlling server 102 includes a 
graphics user interface (not shown) to enable a service provider to schedule data delivery 
by a drag-and-drop operation. Further, the central controlling server 102 authenticates 
and controls the channel servers 104 to start or stop according to delivery matrices. In an 
exemplary embodiment, the central controlling server 102 automatically selects a channel 
and calculates delivery matrices for transmitting data files in the selected channel. The 
central controlling server 102 provides offline addition, deletion, and update of data file 
information (e.g., duration, category, rating, and/or brief description). Further, the central 
controlling server 102 controls the central storage 103 by updating data files and 

databases stored therein. 

In an exemplary embodiment, an existing cable television system 120 may 
continue to feed signals into the combiner/amplifier 108 to provide non-DOD services to 
clients. Thus, the DOD system 100 in accordance with the invention does not disrupt 
present cable television services. 

Figure IB illustrates another exemplar}' embodiment of the DOD system 100 in 
accordance with the invention. In addition to the elements illustrated in Figure 1 A, the 
DOD system 100 includes a switch matrix 1 12, a channel monitoring module 1 14, a set 
of back-up channel servers 1 16a-l 16b, and a set of back-up up-converters 1 18a- 1 18b. In 
one embodiment, the switch matrix 1 12 is physically located between the up-converters 
106 and the combiner/amplifier 108. The switch matrix 1 12 is controlled by the central 
controlling server 102. The channel monitoring module 1 14 comprises a plurality of 
configured set-top boxes, which simulate potential clients, for monitoring the health of 
the DOD system 100. Monitoring results are communicated by the channel monitoring 
module 1 14 to the central controlling server 102. In case of a channel failure (i.e., a 
channel server failure, an up-converter failure, or a communication link failure), the 
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central controlling server 102 through the switch matrix 112 disengages the 
malfunctioning component and engages a healthy backup component 116 and/or 1 18 to 
resume service. 

In an exemplary embodiment, data files being broadcasted from the DOD system 
5 100 are contained in motion pictures expert group (MPEG) files. Each MPEG file is 
dynamically divided into data blocks and sub-blocks mapping to a particular portion of a 
data file along a time axis. These data blocks and sub-blocks are sent during a pre- 
determined time in accordance with three-dimensional delivery matrices provided by the 
central controlling server 102. A feedback channel is not necessary for the DOD system 

10 1 00 to provide DOD services. However, if a feedback channel is available, the feedback 
channel can be used for other purposes, such as billing or providing Internet services. 

Figure 2 illustrates an exemplary channel server 104 in accordance with an 
embodiment of the invention. The channel server 104 comprises a server controller 202, 
a CPU 204, a QAM modulator 206, a local memory 208, and a network interface 210. 

1 5 The server controller 202 controls the overall operation of the channel server 104 by 

instructing the CPU 204 to divide data files into blocks (further into sub-blocks and data 
packets), select data blocks for transmission in accordance with a delivery matrix 
provided by the central controlling server 102, encode selected data, compress encoded 
data, then deliver compressed data to the QAM modulator 206. The QAM modulator 206 

20 receives data to be transmitted via a bus (i.e., PCI, CPU local bus) or Ethernet 

connections. In an exemplary embodiment, the QAM modulator 206 may include a 
downstream QAM modulator, an upstream quadrature amplitude modulation/quadrature 
phase shift keying (QAM/QPSK) burst demodulator with forward error correction 
decoder, and/or an upstream tuner. The output of the QAM modulator 206 is an IF 

25 signals that can be applied directly to an up-converter 1 06. 

The network interface 210 connects the channel server 104 to other channel 
servers 104 and to the central controlling server 102 to execute the scheduling and 
controlling instructions from the central controlling server 102, reporting status back to 
the central controlling server 102, and receiving data files from the central storage 103. 

30 Any data file retrieved from the central storage 103 can be stored in the local memory 
208 of the channel server 104 before the data file is processed in accordance with 
instructions from the server controller 202. In an exemplary embodiment, the channel 
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server 104 may send one or more DOD data streams depending on the bandwidth of a 
cable channel (e.g., 6, 6.5, or 8MHz), QAM modulation (e.g., QAM 64 or QAM 256, and 
a compression standard/bit rate of the DOD data stream (i.e., MPEG-1 or MPEG-2). 
Figure 3 illustrates an exemplary set-top box (STB) 300 in accordance with an 
5 embodiment of the invention. The STB 300 comprises a QAM demodulator 302, a 
CPU 304, a conditional access module 306 (e.g., a smart card system), a local memory 
308, a buffer memory 309, a STB controller 310, a decoder 312, and a graphics overlay 
module 314. The STB controller 310 controls the overall operation of the STB 300 by 
controlling the CPU 302 and the QAM demodulator 302 to select data in response to a 
1 0 client's request, decode selected data, decompress decoded data, re-assemble decoded 

5 data, store decoded data in the local memory 308 or the buffer memory 309, and deliver 
stored data to the decoder 312. In an exemplary embodiment, the STB controller 310 
controls the overall operation of the STB 300 based on data packet headers in the data 
packets received from the transmission medium 110. In an exemplary embodiment, the 
1 5 local memory 308 comprises non-volatile memory (e.g., a hard drive) and the buffer 
memory 309 comprises volatile memory. 

In one embodiment, the QAM demodulator 302 comprises transmitter and 
receiver modules and one or more of the following: privacy encryption/decryption 
module, forward error correction decoder/encoder, tuner control, downstream and 

20 upstream processors, CPU and memory interface circuits. The QAM demodulator 302 
receives modulated IF signals, samples and demodulates the signals to restore data. 

The conditional access module 306 permits a decoding process when access is 
granted after authentication and/or when appropriate fees have been charged. Access 
condition is determined by the service provider. 

25 Methods of authentication include inserting subscription levels and warning levels 

directly into the headers of transmitted DOD data. In such methods the STB 300 reads 
these subscription levels and compares them to subscription levels stored within the STB 
300. If a stored subscription level matches the subscription level transmitted with a DOD 
service, the client is authorized to receive the service. In the case of warning levels an 

30 STB 300 reads a warning level transmitted within a DOD service and displays a message 
corresponding to the warning level. These authentication methods are taught by Khoi 
Hoang's patent application entitled Controlling Data-On-Demand Client Access, 
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filed on July 9, 2001, bearing application number 09/902,503, which has been 
incorporated by reference. 

In an exemplary embodiment, when access is granted, the decoder 312 decodes at 
least one data block to transform the data block into images displayable on an output 
5 screen. The decoder 312 supports commands from a subscribing client, such as play, 
stop, pause, step, rewind, forward, etc. 

The graphics overlay module 314 enhances displayed graphics quality by, for 
example, providing alpha blending or picture-in-picture capabilities. In an exemplary 
embodiment, the graphics overlay module 314 can be used for graphics acceleration 
10 during game playing mode, for example, when the service provider provides games-on- 
demand services using the system in accordance with the invention. 
!■ Q In an exemplary embodiment, although data files are broadcasted to all cable 

l % television subscribers, only the DOD subscriber who has a compatible STB 300 will be 
==! able to decode and enjoy data-on-demand services. In one exemplary embodiment, 
|S 1 5 permission to obtain data files on demand can be obtained via a smart card system in the 
M conditional access control module 306. A smart card may be rechargeable at a local store 
:U or vending machine set up by a service provider. In another exemplary embodiment, a 

flat fee system provides a subscriber unlimited access to all available data files. 
10 In an exemplary embodiment, data-on-demand interactive features permit a client 

; : : 20 to select at any time an available data file. The amount of time between when a client 

presses a select button and the time the selected data file begins playing is referred to as a 
response time. As more resources are allocated (e.g., bandwidth, server capability) to 
provide DOD services, the response time gets shorter. In an exemplary embodiment, a 
response time can be determined based on an evaluation of resource allocation and 
25 desired quality of service. 

In an exemplary embodiment, a selected response time determines the duration of 
a time slot. The duration of a time slot (TS) is the time interval for playing a data block 
at normal speed by a client. In an exemplary embodiment, a data file, such as a video 
file, is divided into a number of data blocks such that each data block can support the 
30 playing of the data file for the duration of a time slot. 

In one embodiment, the number of data blocks (NUM_OF_BLKS) for each data 
file can be calculated as follows: 
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EstimatedBLKSize = (DataFile Size * TS) / DataFile Length (1) 
BLK SIZE = (Estimated BLK Size + CLUSTER SIZE - lByte) / CLUSTER JSIZE (2) 
BLKSIZEBYTES = BLK_SIZE * CLUSTER_SIZE (3) 
NUM_OF_BLKS =(DataFile_Size + BLK SIZE BYTES - 1 Byte)/BLK_SIZE_B YTES (4) 

5 

In equations (1) to (4), the Estimated_BLK_Size is an estimated block size (in 
Bytes); the DataFile_Size is the data file size (in Bytes); TS represents the duration of a 
time slot (in seconds); DataFile Length is the duration of the data file (in seconds); BLK 
SIZE is the number of clusters needed for each data block; CLUSTER SIZE is the size 
10 of a cluster in the local memory 208 for each channel server 104 (e.g., 64KBytes); 

BLK SIZE BYTES is a block size in Bytes. In this embodiment, the number of blocks 
[f (NUMOFBLKS) is equal to the data file size (in Bytes) plus a data block size in Bytes 
- minus 1, Byte and divided by a data block size in Bytes. Equations (1) to (4) illustrate 

one specific embodiment. A person of skill in the art would recognize that other methods 
1 5 are available to calculate a number of data blocks for a data file. For example, dividing a 
111 data file into a number of data blocks is primarily a function of an estimated block size 
[ and the cluster size of the local memory 208 of a channel server 104. Thus, the invention 

H should not be limited to the specific embodiment presented above. 

Figure 4 illustrates an exemplary process for generating a scheduling matrix for 
3 20 sending a data file in accordance with an embodiment of the invention. In an exemplary 
embodiment, this invention uses time division multiplexing (TDM) and frequency division 
multiplexing (FDM) technology to compress and schedule data delivery at the server side. 
In an exemplary embodiment, a scheduling matrix is generated for each data file. In one 
embodiment, each data file is divided into a number of data blocks and the scheduling 
25 matrix is generated based on the number of data blocks. Typically, a scheduling matrix 
provides a send order for sending data blocks of a data file from a server to clients, such 
that the data blocks are accessible in sequential order by any client who wishes to access 
the data file at a random time. 

At step 402, a number of data blocks (x) for a data file is received. A first 
30 variable, j, is set to zero (step 404). A reference array is cleared (step 406). The 

reference array keeps track of data blocks for internal management purposes. Next, j is 
compared to x (step 408). If j is less than x, a second variable, i, is set to zero (step 412). 
Next, i is compared to x (step 414). If i is less than x, data blocks stored in the column 
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[(i+j) modulo (x)] of a scheduling matrix are written into the reference array (step 418). If 
the reference array already has such data block(s), do not write a duplicate copy. 
Initially, since the scheduling matrix does not yet have entries, this step can be skipped. 
Next, the reference array is checked if it contains data block i (step 420). Initially, since 
5 all entries in the reference array have been cleared at step 406, there would be nothing in 
the reference array. If the reference array does not contain data block i, data block i is 
added into the scheduling matrix at matrix position [(i+j) modulo (x), j] and the reference 
array (step 422). After the data block i is added to the scheduling matrix and the 
reference array, i is incremented by 1, such that i = i + 1 (step 424), then the process 

10 repeats at step 414 until i = x. If the reference array contains data block i, i is incremented 
by 1, such that i = i + 1 (step 424), then the process repeats at step 414 until i = x. When 
i = x, j is incremented by 1, such that j = j + 1 (step 416) and the process repeats at step 
406 until j = x. The entire process ends when j = x (step 410). 

In an exemplary embodiment, if a data file is divided into six data blocks (x = 6), 

15 the scheduling matrix and the reference arrays are as follows: 

Scheduling Matrix (SM) 



TSO 


TSl 


TS2 


TS3 


TS4 


TS5 


[0, 0] blkO 


[1,0] blkl 


[2, 0] blk2 


[3, 0] blk3 


[4, 0] blk4 


[5, 0] blk5 


[0,1] 


[1, l]blk0 


[2,1] 


[3, 1] 


[4,1] 


[5,1] 


[0,2] 


[1,2] 


[2, 2] blkO 


[3, 2] blkl 


[4, 2] 


[5, 2] 


[0,3] 


[1,3] 


[2,3] 


[3, 3] blkO 


[4, 3] 


[5, 3] blk2 


[0, 4] 


[1, 4] blk3 


[2, 4] 


[3,4] 


[4, 4] blkO 


[5, 5] blkl 


[0,5] 


[1,5] 


[2, 5] 


[3, 5] blk4 


[4, 5] 


[5, 5] blkO 



Reference Array (RA) 





spaceO 


spacel 


space2 


space3 


space4 


spaceS 


TSO 


blkO 


blkl 


blk2 


blk3 


blk4 


blk5 


TSl 


blkl 


blkO 


blk2 


blk3 


blk4 


blk5 


TS2 


blk2 


blkO 


blk3 


blkl 


blk4 


blk5 


TS3 


blk3 


blkl 


blkO 


blk4 


blk5 


blk2 


TS4 


blk4 


blkO 


blk5 


blk2 


blkl 


blk3 


TS5 


blk5 


blk2 


blkl 


blkO 


blk3 


blk4 



20 In this exemplary embodiment, based on the scheduling matrix above, the six data 

blocks of the data file are sent in the following sequence: 
TSO => blkO 
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TSI => blkO, blkl, blk3 

TS2 => blkO, blk2 

TS3 => blkO, blkl, blk3, blk4 

TS4 => blkO, blk4 

TS5 => blkO, blkl, blk2, blk5 

In another exemplary embodiment, a look-ahead process can be used to calculate a 
look-ahead scheduling matrix to send a predetermined number of data blocks of a data 
file prior to a predicted access time. For example, if a predetermined look-ahead time is 
the duration of one time slot, for any time slot greater than or equal to time slot number 
four, data block 4 (blk4) of a data file should be received by a STB 300 at a subscribing 
client at or before TS3, but blk4 would not be played until TS4. The process steps for 
generating a look-ahead scheduling matrix is substantially similar to the process steps 
described above for Figure 4 except that the look-ahead scheduling matrix in this 
embodiment schedules an earlier sending sequence based on a look-ahead time. 
Assuming a data file is divided into six data blocks, an exemplary sending sequence 
based on a look-ahead scheduling matrix, having a look-ahead time of the duration of two 
time slots, can be represented as follows: 
TSO => blkO 

TSI => blkO, blkl, blk3, blk4 
TS2 => blkO, blk2 
TS3 => blkO, blkl, blk3, blk4, blk5 
TS4 => blkO, blk5 
TS5=>blkO, blkl,blk2 

A three-dimensional delivery matrix for sending a set of data files is generated 
based on the scheduling matrices for each data file of the set of data files. In the three- 
dimensional delivery matrix, a third dimension containing IDs for each data file in the set 
of data files is generated. The three-dimensional delivery matrix is calculated to 
efficiently utilize available bandwidth in each channel to deliver multiple data streams. 
In an exemplary embodiment, a convolution method, which is well known in the art, is 
used to generate a three-dimensional delivery matrix to schedule an efficient delivery of a 
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set of data files. For example, a convolution method may include the following policies: 
(1) the total number of data blocks sent in the duration of any time slot (TS) should be 
kept at a smallest possible number; and (2) if multiple partial solutions are available with 
respect to policy (1), the preferred solution is the one which has a smallest sum of data 
5 blocks by adding the data blocks to be sent during the duration of any reference time slot, 
data blocks to be sent during the duration of a previous time slot (with respect to the 
reference time slot), and data blocks to be sent during the duration of a next time slot 
(with respect to the reference time slot). For example, assuming an exemplary system 
sending two short data files, M and N, where each data file is divided into six data blocks, 
1 0 the sending sequence based on a scheduling matrix is as follows: 



TSO => blkO 

TS1 => blkO, blkl, blk3, blk4 

TS2 => blkO, blk2 

TS3 => blkO, blkl, blk3, blk4 

TS4 => blkO, blk4 

TS5 => blk0,blkl,blk2, blk5 



Applying the exemplary convolution method as described above, possible 
combinations of delivery matrices are as follows: 



Option 1 : Send video file N at shift 0 TS 



Total Data Blocks 



TSO => MO, NO 

TS1 =>MO,Ml,M3,NO,NI,N3 

TS2 => MO, M2, NO, N2 

TS3 => MO, Ml, M3, M4, NO, Nl, N3, N4 

TS4 => MO, M4, NO, N4 

TS5 =>M0, MI, M2, M5, NO, NI, N2, N5 



4 



8 



4 



2 



6 



8 



20 



Option 2: Send video file N at shift 1 TS 



Total Data Blocks 



TS0=>M0,N0,N1,N3 



4 
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TS 1 => MO, MI, M3, NO, N2 5 
TS2 => MO, M2, NO, Nl, N3, N4 6 
TS3 =>M0, MI, M3 , M4, NO, N4 6 
TS4 => MO, M4, NO, Nl, N2, N5 6 
TS5 => MO, Ml, M2, M5, NO 5 

Option 3: Send video File N at shift 2 TS Total Data Blocks 



TSO => MO, NO, N2 3 

TS1 =>M0, Ml, M3,N0,N1,N3,N4 7 

TS2 => MO, M2, NO, N4 4 

TS3 =>MO, Ml, M3, M4, NO, Nl , N2, N5 8 

TS4=>M0,M4,N0 3 

TS5 => MO, Ml, M2, M5, NO, Nl, N3 7 

Option 4: Send video file N at shift 3 TS Total Data Blocks 



TS0=>M0,N0,N1,N3,N4 5 

TS1 =>MO,Ml,M3,N0,N4 5 

TS2 => MO, M2, NO, Nl, N2, N5 6 

TS3 =>M0, Ml, M3, M4, NO 5 

TS4 => MO, M4, NO, Nl, N3 5 

TS5 => MO, Ml, M2, M5, NO, Nl , N2 6 

Option 5 : Send video file N at shift 4 TS Total Data Blocks 



TSO =>MO,N0,N4 3 

TS1 =>M0, Ml,M3,NO, N1,N2, N5 7 

TS2 =>M0, M2, NO 3 

TS3 =>M0, MI, M3, M4, NO, Nl, N3 7 

TS4 =>M0, M4, N0,N2 4 
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TS5 =>M0, Ml, M2, MS, NO, Nl, N3, N4 
Option 6: Send video file N at shift 5 TS 



8 



Total Data Blocks 



TSO =>M0,NO,Nl,N2,N5 
TS1 =>M0,M1,M3,N0 
TS2 =>M0, M2, NO, Nl, N3 
TS3 =>M0, Ml, M3, M4, NO, N2 
TS4 =>M0, M4, NO, Nl, N3, N4 
TS5 =>M0,M1,M2,M5,N0,N4 



Applying policy (1), options 2, 4, and 6 have the smallest maximum number of 
5 data blocks (i.e., 6 data blocks) sent during any time slot. Applying policy (2), the 

optimal delivery matrix in this exemplary embodiment is option 4 because option 4 has 
the smallest sum of data blocks of any reference time slot plus data blocks of neighboring 
time slots (i.e., 16 data blocks). Thus, optimally for this embodiment, the sending 
sequence of the data file N should be shifted by three time slots. In an exemplary 
1 0 embodiment, a three-dimensional delivery matrix is generated for each channel server 
104. 

When data blocks for each data file are sent in accordance with a delivery matrix, a 
large number of subscribing clients can access the data file at a random time and the 
appropriate data blocks of the data file will be timely available to each subscribing client. 
1 5 In the example provided above, assume the duration of a time slot is equal to 5 seconds, 
the DOD system 100 sends data blocks for data files M and N in accordance with the 
optimal delivery matrix (i.e., shift delivery sequence of data file N by three time slots) in 
the following manner: 

Time 00:00:00=> MO NO Nl N3 N4 
20 Time 00:00:05=> MO Ml M3 NO N4 

Time 00:00: 10=> M0 M2 NO Nl N2 N5 
Time 00:00: 1 5=> M0 Ml M3 M4 NO 
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Time 00:00:20= 
Time 00:00:25= 
Time 00:00:30= 
Time 00:00:35= 
Time 00:00:40= 
Time 00:00:45= 
Time 00:00:50= 
Time 00:00:55= 



>M0 M4 N0N1N3 
o MO Ml M2 M5 NO N2 
=>M0N0N1 N3N4 
=> MO Ml M3 NO N4 
=> MO M2 NO Nl N2 N5 
=>M0M1 M3M4N0 
=> MO M4 NO Nl N3 
=> MO Ml M2 M5 NO N2 



If at time 00:00:00 a client A selects movie M, the STB 300 at client A receives, 
stores, plays, and rejects data blocks as follows: 



Time 00:00:00 => Receive MO 

Time 00:00:05 => Receive Ml, M3 

Time 00:00: 1 0 => Receive M2 

Time 00:00: 1 5 => Receive M4 

Time 00:00:20 => Receive none 

Time 00:00:25 => Receive M5 



=> play MO, store MO. 

=> play Ml, store MO, Ml, M3. 

=> play M2, store MO, Ml, M2, M3. 

=> play M3, store MO, Ml, M2, M3, M4. 

=> play M4, store MO, Ml, M2, M3, M4. 

=> play M5, store MO, Ml, M2, M3, M4, M5. 



If at time 00:00:10, a client B selects movie M, the STB 300 at client B receives, 
stores, plays, and rejects data blocks as follows: 



Time 00:00: 1 0 => Rev MO, M2 

Time 00:00:15 =>Rcv Ml, M3, M4 

Time 00:00:20 => Rev none 

Time 00:00:25 => Rev M5 

Time 00: 00:3 0 => Rev none 

Time 00:00:35 => Rev none 



=> play M0, store M0, M2. 

=> play Ml, store M0, Ml, M2, M3,M4. 

=> play M2, store M0, Ml, M2, M3, M4. 

=> play M3, store M0, Ml, M2, M3, M4, M5. 

=> play M4, store M0, Ml, M2, M3, M4, M5. 

=> play M5, store M0, Ml, M2, M3, M4, M5. 



If at time 00:00:15, a client C selects movie N, the STB 300 of the client C 
receives, stores, plays, and rejects data blocks as follows: 



Time 00:00:15 =>RcvN0 



=> play NO, store NO. 
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Time 00:00:20 => Rev Nl N3 

Time 00:00:25 => Rev N2 

Time 00:00:30 => Rev N4 

Time 00:00:35 => Rev none 

Time 00:00:40 => Rev N5 



=> play Nl, store NO, Nl, N3. 
=> play N2, store NO, Nl, N2, N3. 
=> play N3, store NO, Nl, N2, N3, N4. 
=> play N4, store NO, Nl, N2, N3, N4. 
=> play N5, store NO, Nl, N2, N3, N4, N5. 



If at time 00:00:30, a client D also selects movie N, the STB 300 at the client D 
receives, stores, plays, and rejects data blocks as follows: 



Time 00:00:30 => RcvN0,Nl,N3,N4 

Time 00:00:35 => Rev none 

Time 00:00:40 =>RcvN2,N5 

Time 00:00:45 => Rev none 

Time 00:00:50 => Rev none 

Time 00:00:55 => Rev none 



=> play NO, store NO, Nl, N3, N4. 

=> play Nl, store NO, Nl, N3, N4. 

=> play N2, store NO, Nl, N2, N3, N4, N5. 

=> play N3, store NO, Nl, N2, N3, N4, N5. 

=> play N4, store NO, Nl, N2, N3, N4, N5. 

=> play N5, store NO, Nl, N2, N3, N4, N5. 



As shown in the above examples, any combination of clients can at a random time 
independently select and begin playing any data file provided by the service provider. If 
insufficient bandwidth is available to transmit a given number of data files with the above 
embodiment, it would be possible to transmit a greater quantity of data with a slight time 
delay using a sub-optimal transmission schedule as discussed below. While the above 
methods provide client generic DOD services in a time optimal manner, the following 
processes teach methods for providing client generic DOD broadcast services that further 
reduce required transmission bandwidth in exchange for a delay in access time. 

FIG. 5 illustrates an exemplary method at 500 for creating a sub-optimal scheduling 
matrix. In accordance with one embodiment, this invention uses time division 
multiplexing (TDM) and frequency division multiplexing (FDM) technology to compress 
and schedule data delivery at the server side. In an exemplary embodiment, a sub-optimal 
scheduling matrix is generated for each data file. In one embodiment, each data file is 
divided into a number of data blocks and a sub-optimal scheduling matrix is generated 
based on the number of data blocks. The sub-optimal scheduling matrix provides a send 
order for sending data blocks of a data file from a server to clients, such that the data 
blocks are accessible in sequential order by any client who wishes to access the data file 
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within one time slot of a random starting time. 

At step 502, a number of data blocks (x) for a data file is received. A first 
variable, j, is set to zero (step 504). A reference array is cleared (step 506). The 
reference array keeps track of data blocks for internal management purposes. Next, j is 
5 compared to x (step 508). If j is less than x, a second variable, i, is set to zero (step 512). 
Next, i is compared to x (step 514). If i is less than x, data blocks stored in the column 
[(i+j) modulo (x)] of a sub-optimal scheduling matrix are written into the reference array 
(step 518). If the reference array already has such data block(s), do not write a duplicate 
copy. Initially, since the sub-optimal scheduling matrix does not yet have entries, this 

10 step can be skipped. Next, the reference array is checked for whether it contains data 

\ block i (step 520). Initially, since all entries in the reference array have been cleared at 
step 506, there would be nothing in the reference array. If the reference array does not 
contain data block i, the previous column (i-1) of the sub-optimal scheduling matrix is 
checked for whether column (i-1) of the matrix contains the data block i (step 521). If 

15 column i-1 of the sub-optimal matrix also does not contain data block i, data block i is 
added into the sub-optimal scheduling matrix at matrix position [(i+j) modulo (x), j] and 
the reference array (step 522). After the data block i is added to the sub-optimal 
scheduling matrix and the reference array, i is incremented by 1 , such that i = i + 1 (step 
524), then the process repeats at step 514 until i = x. If the reference array contains data 

20 block i or column (i-1) of the sub-optimal scheduling matrix contains data block i, i is 

incremented by 1 , such that i = i + 1 (step 524), then the process repeats at step 514 until i 
= x. When i = x, j is incremented by 1, such that j = j + 1 (step 516) and the process 
repeats at step 506 until j = x. The entire process ends when j = x (step 510). 

In an exemplary embodiment, if a data file is divided into six data blocks (x = 6), 

25 the sub-optimal scheduling matrix and the reference arrays are as follows: 



Sub-Optimal Scheduling Matrix (SSM) 



TS0 


TS1 


TS2 


TS3 


TS4 


TS5 


[0, 0] blkO 


[1,0] blkl 


[2, 0] blk2 


[3, 0] blk3 


[4, 0] blk4 


[5, 0] blk5 


[0, 1] 


[1,1] 


[2,1] 


[3, 1] 


[4, 1] 


[5, 1] 


[0,2] 


[1,2] 


[2, 2] blkO 


[3, 2] blkl 


[4, 2] 


[5, 2] 


[0, 3] 


[1,3] 


[2,3] 


[3, 3] 


[4, 3] 


[5, 3] blk2 


[0, 4] 


[1,4] blk3 


[2,4] 


[3,4] 


[4, 4] blkO 


[5, 5] blkl 


[0, 5] 


[1,5] 


[2, 5] 


[3, 5] blk4 


[4, 5] 


[5, 5] 
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Reference Array (RA) 





spaceO 


spacel 


space2 


space3 


space4 


space5 


TSO 


blkO 


blkl 


blk2 


blk3 


blk4 


blk5 


TS1 


blkl 


blkO 


blk2 


blk3 


blk4 


blk5 


TS2 


blk2 


blkO 


blk3 


blkl 


blk4 


blk5 


TS3 


blk3 


blkl 


blkO 


blk4 


blk5 


blk2 


TS4 


blk4 


blkO 


blk5 


blk2 


blkl 


blk3 


TS5 


blk5 


blk2 


blkl 


blkO 


blk3 


blk4 



In this exemplary embodiment, based on the sub-optimal scheduling matrix 
above, the six data blocks of the data file are sent in the following sequence: 
TSO => blkO 
TSI => blkl, blk3 
TS2 => blkO, blk2 
TS3 => blkl, blk3, blk4 
TS4 => blkO, blk4 
TS5 => blkl, blk2, blk5 



When compared to the exemplary "optimal" scheduling sequence of FIG. 4, this 
exemplary "sub-optimal" scheduling sequence transmits 3 fewer data blocks. This results 
in a transmission utilizing the exemplary sub-optimal schedule requiring 18.75% less 
bandwidth. This sub-optimal schedule requires a receiving STB to delay displaying a 
selected data file to a user for a duration of one time slot. 

The sub-optimal schedule of the above embodiment is only one of an infinite 
number of possible specific scheduling schemes as would be apparent to those skilled in 
the art. Greater reduction in the bandwidth required to transmit data files may be 
achieved by using greater delays in STB access time. Examples would include 
transmissions requiring a delay of 2 or more time slots before a receiving STB could 
display a selected data file. 

FIG. 6 illustrates an exemplary STB method for receiving "sub-optimal" DOD 
data transmissions in accordance with one embodiment of the present invention. The 
process 600 starts at a step 602 at which the STB 300 (FIG. 3) receives an electronic 
guide program (EPG) from the DOD broadcast system 100 (FIG. 1A). The EPG program 
lists all files available from the DOD system 100. In step 603 a user selects a data file 
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listed on the EPG by pressing a purchase button associated with the desired data file. In 
step 604 the STB 300 (FIG. 3) begins storing data blocks of the selected data file. The 
STB waits a predetermined time period to allow enough data blocks of the selected data 
fde to be stored such that the STB may play the data file without interruption. In 
5 accordance with one embodiment the CPU 304 (FIG. 3) is capable of determining how 
much delay is necessary to assure smooth play of a selected data file. This could be 
accomplished with various algorithms or by simply including required delay information 
in a packet header location within the data transmitted from the DOD system 100. In 
such an embodiment the DOD system varies sub-optimal delivery matrices such that the 
1 0 number of time slots of delay required is dependent on available transmission bandwidth. 

Once the STB has delayed long enough to store data blocks necessary for 
uninterrupted display of the selected data file, the STB automatically begins playing the 
S selected data file. In accordance with an alternative embodiment the STB prompts a user 
i to begin display of a selected data file once the delay period is complete. 

i5 

GENERAL OPERATION 

3 A service provider can schedule to send a number of data files (e.g., video files) to 

channel servers 104 prior to broadcasting. The central controlling server 102 calculates 

20 and sends to the channel servers 104 three-dimensional delivery matrices (ID, time slot, 
and data block send order). During broadcasting, channel servers 104 consult the three- 
dimensional delivery matrices to send appropriate data blocks in an appropriate order. 
Each data file is divided into data blocks so that a large number of subscribing clients can 
separately begin viewing a data file continuously and sequentially at a random time. The 

25 size of a data block of a data file is dependent on the duration of a selected time slot and 
the bit rate of the data stream of the data file. For example, in a constant bit rate MPEG 
data stream, each data block has a fixed size of: Block Size (MBytes) = BitRate (Mb/s) x 
TS (see) / 8 (1). 

In an exemplary embodiment, a data block size is adjusted to a next higher 
30 multiple of a memory cluster size in the local memory 208 of a channel server 104. For 
example, if a calculated data block length is 720Kbytes according to equation (1) above, 

METHODS AND SYSTEMS FOR GENERATING DATA-ON DEMAND SUB-OPTIMAL BROADCAST DELIVERY 

MATRICES, Page 21 , 60595-300601, TRK 

SV: 199446 v04 11/28/2001 



then the resulting data block length should be 768Kbytes if the cluster size of the local 
memory 208 is 64Kbytes. In this embodiment, data blocks should be further divided into 
multiples of sub-blocks each having the same size as the cluster size. In this example, the 
data block has twelve sub-blocks of 64KBytes. 
5 A sub-block can be further broken down into data packets. Each data packet 

contains a packet header and packet data. The packet data length depends on the 
maximum transfer unit (MTU) of a physical layer where each channel server's CPU 
sends data to. In the preferred embodiment, the total size of the packet header and packet 
data should be less than the MTU. However, for maximum efficiency, the packet data 
1 0 length should be as long as possible. 

2 In an exemplary embodiment, data in a packet header contains information that 

2 permits the subscriber client's STB 300 to decode any received data and determine if the 

3 data packet belongs to a selected data file (e.g., protocol signature, version, ID, or packet 
t type information). The packet header may also contain other information, such as 

1 5 required "sub-optimal" delay period, block/sub-block/packet number, packet length, 

cyclic redundancy check (CRC) and offset in a sub-block, and/or encoding information. 
* Once received by a channel server 1 04, data packets are sent to the QAM 

LJ modulator 206 where another header is added to the data packet to generate a QAM- 
S modulated IF output signal. The maximum bit rate output for the QAM modulator 206 is 
ho dependent on available bandwidth. For example, for a QAM modulator 206 with 6MHz 
bandwidth, the maximum bit rate is 5.05 (bit/symbol) x 6 (MHz) = 30.3 Mbit/sec. 

The QAM-modulated IF signals are sent to the up-converters 106 to be converted 
to RF signals suitable for a specific channel (e.g., for CATV channel 80, 559.250MHz 
and 6MHz bandwidth). For example, if a cable network has high bandwidth (or bit rate), 
25 each channel can be used to provide more than one data stream, with each data stream 
occupying a virtual sub-channel. For example, three MPEG1 data streams can fit into a 
6MHz channel using QAM modulation. The output of the up-converters 106 is applied to 
the combiner/amplifier 108, which sends the combined signal to the transmission medium 
110. 

30 In an exemplary embodiment, the total system bandwidth (BW) for transmitting 

"N" data streams is BW = N x bw, where bw is the required bandwidth per data stream. 
For example, three MPEG-1 data streams can be transmitted at the same time by a 
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DOCSIS cable channel having a system bandwidth of 30.3 Mbits/sec. because each 
MPEG-1 data stream occupies 9 Mbits/sec of the system bandwidth. 

Typically, bandwidth is consumed regardless of the number of subscribing clients 
actually accessing the DOD service. Thus, even if no subscribing client is using the DOD 
5 service, bandwidth is still consumed to ensure the on-demand capability of the system. 

The STB 300, once turned on, continuously receives and updates a program guide 
stored in the local memory 308 of a STB 300. In an exemplary embodiment, the STB 300 
displays data file information including the latest program guide on a TV screen. Data 
file information, such as video file information, may include movielD, movie title, 
10 description (in multiple languages), category (e.g., action, children), rating (e.g., R, 
PG1 3), cable company policy (e.g., price, length of free preview), subscription period, 
.n movie poster, and movie preview. In an exemplary embodiment, data file information is 
; ~ sent via a reserved physical channel, such as a channel reserved for firmware update, 
J commercials, and/or emergency information. In another exemplary embodiment, 
nl 5 information is sent in a physical channel shared by other data streams. 
& A subscribing client can view a list of available data files arranged by categories 

= =_ displayed on a television screen. When the client selects one of the available data files, 
; :i the STB 300 controls its hardware to tune into a corresponding physical channel and/or a 
n virtual sub-channel to start receiving data packets for that data file. The STB 300 
^20 examines every data packet header, decodes data in the data packets, and determines if a 
received data packet should be retained. If the STB 300 determines that a data packet 
should not be retained, the data packet is discarded. Otherwise, the packet data is saved in 
the local memory 308 for later retrieval or is temporarily stored, in the buffer memory 
309 until it is sent to the decoder 312. 
25 To improve performance efficiency by avoiding frequent read/write into the local 

memory 308, in an exemplary embodiment, the STB 300 uses a "sliding window" 
anticipation technique to lock anticipated data blocks in the memory buffer 309 whenever 
possible. Data blocks are transferred to the decoder 312 directly out of the memory buffer 
309 if a hit in an anticipation window occurs. If an anticipation miss occurs, data blocks 
30 are read from the local memory 308 into the memory buffer 309 before the data blocks 
are transferred to the decoder 312 from the memory buffer 309. 

In an exemplary embodiment, the STB 300 responds to subscribing client's 

METHODS AND SYSTEMS FOR GENERATING DATA-ON DEMAND SUB-OPTIMAL BROADCAST DELIVERY 

MATRICES, Page 23 , 60595-300601, TRK 

SV: 199446 v04 11/28/2001 



commands via infrared (IR) remote control unit buttons, an IR keyboard, or front panel 
pushbuttons, including buttons to pause, play in slow motion, rewind, zoom and single 
step. In an exemplary embodiment, if a subscribing client does not input any action for a 
predetermined period of time (e.g., scrolling program menu, or selecting a category or 
5 movie), a scheduled commercial is played automatically. The scheduled commercial is 
automatically stopped when the subscribing client provides an action (e.g., press a button 
in a remote control unit). In another exemplary embodiment, the STB 300 can 
automatically insert commercials while a video is being played. The service provider 
(e.g., a cable company) can set up a pricing policy that dictates how frequently 
1 0 commercials should interrupt the video being played. 

3 If an emergency information bit is found in a data packet header, the STB 300 

S pauses any data receiving operation and controls its hardware to tune into the channel 
3 reserved for receiving data file information to obtain and decode any emergency 
=5 information to be displayed on an output screen. In an exemplary embodiment, when the 
\ 5 STB 300 is idled, it is tuned to the channel reserved for receiving data file information 
and is always ready to receive and display any emergency information without delay. 
The foregoing examples illustrate certain exemplary embodiments of the 
| invention from which other embodiments, variations, and modifications will be apparent 
: to those skilled in the art. The invention should therefore not be limited to the particular 
=20 embodiments discussed above, but rather is defined by the following claims. 
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